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Abstract 

We consider the model of the one- dimensional cookie random walk when the 
initial cookie distribution is spatially uniform and the number of cookies per site 
is finite. We give a criterion to decide whether the limiting speed of the walk is 
non-zero. In particular, we show that a positive speed may be obtained for just 3 
cookies per site. We also prove a result on the continuity of the speed with respect 
to the initial cookie distribution. 
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1 Introduction 

We consider the model of the multi-excited random walk, also called cookie random walk, 
introduced by Zerner in [10] as a generalization of the model of the excited random 
walk described by Benjamini and Wilson in [2] (see also Davis [3] for a continuous time 
analogue). The aim of this paper is to study under which conditions the speed of a cookie 
random walk is strictly positive. In dimension d > 2, this problem was solved by Kozma 
P,[7] who proved that the speed is always non-zero. In the one-dimensional case, the speed 
can either be zero or strictly positive. We give here a necessary and sufficient condition 
to determine if the walk's speed is strictly positive when the initial cookie environment is 
deterministic, spatially uniform and with a finite number of cookies per site. Let us start 
with an informal definition of such a process: 

Let us put M > 1 "cookies" at each site of Z and let us pick pi,p 2 , . . . ,Pm £ [§, 1)- 
We say that pi represents the "strength" of the i th cookie at any given site. Then, a cookie 
random walk X = (X„) n > is simply a nearest neighbour random walk, eating the cookies 
it finds along its path by behaving in the following way: 
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• If X n = x and there is no remaining cookie at site x, then X jumps at time n + 1 
to x + 1 or x — 1 with equal probability \. 

• If X n = x and there remain the cookies with strengths Pj,Pj+i, ■ ■ ■ ,Pm at this site, 
then X eats the cookie with attached strength pj (which therefore disappears from 
this site) and then jumps at time n + 1 to x + 1 with probability pj and to x — 1 
with probability 1 — pj. 

This model is a particular case of self-interacting random walk: the position of X at time 
n + 1 depends not only of its position at time n but also on the number of previous visits 
to its present site. Therefore, X is not a Markov process. 

Let us now give a formal description of the general model. We define the set of 
cookie environments by Q = [|, l] N * xZ . Thus, a cookie environment is of the form u = 
(uj(i,x))i>i tXe z where x) represents the strength of the i th cookie at site x. Given 
x G Z and uj G f2, a cookie random walk starting from x in the cookie environment u) is 
a process (X n ) n > on some probability space (f2, JF, P w x ) such that: 

Plu,x{Xo — z} — 1, 
Po;,x{|^n+l — X n \ = 1} = 1, 

P Wl *{*n+i =X n + l\ X 1 ,...,X n } = u(J, X n ) where j = Jj{0 < i < n , X t = X n }. 

In this paper, we restrict our attention to the set of environments Vt\ { C Vt which are 
spatially uniform with at most M > 1 cookies per site: 

{for all x G Z and alH > 1 u)(i, x) = uj(i, 0), 
for alH > M u{i,0) = \, 
for all z > 1 0) < 1. 

The last condition u{i, 0) < 1 is introduced only to exclude some possible degenerated 
cases but can be relaxed (see Remark 12.41) . A cookie environment u G fl^j may be 
represented by (M,p) where 

p= (p u ...,pm) = Kl,0),...,w(M,0)). 

In this case, we shall say that the associated cookie random walk is an (M, p)-cookie 
random walk and we will use the notation P(m,p) instead of P^. 

The question of the recurrence or transience of a cookie random walk was solved by 
Zerner in [10] for general cookie environments (even in the case where the initial cookie 
environment may itself be random). In particular, he proved that, if X is an (M,p) cookie 
random walk, there is a phase transition according to the value of 

M 

« = «(M,p) d = f ^(2p,-l)-l. (1) 

i=l 

• If a < then the walk is recurrent i.e. limsupX n = — liminfX n = +oo a.s. 

• If a > then X is transient toward +oo i.e limX n = +oo a.s. 
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In particular, for M = 1, the cookie random walk is always recurrent for any choice of p. 
However, as soon as M > 2, the cookie random walk can either be transient or recurrent 
depending on p. Zerner [10] also proved that the speed of a (M,p) -cookie random walk 
X is always well defined (but may or not be zero). Precisely, 

• there exists a constant v(M,p) > such that 

X n , _. 

— — ► v(M,p) P(Mp)-almost surely. 

• The speed is monotonic in p: if p = (pi, . . . ,Pm) and q = (qi, . . . , q^) are two cookie 
environments such that Pi < qi for all i, then v(M,p) < v(M, q). 

• The speed of a (2,p)-cookie random walk is always 0. 

The question of whether one can construct a (M,p) -cookie random walk with strictly 
positive speed was affirmatively answered by Mountford, Pimentel and Valle [8] who 
considered the case where all the cookies have the same strength p G [|, 1) i.e. the cookie 

vector p has the form [p]m = (p, . . . ,p). They showed that: 

• For any p G (|, 1), there exists an M such that for all M > M the speed of the 
(M, [p]A/)-cookie random walk is strictly positive. 

• If M{2p — 1) < 2, then the speed of the (M, \p]m) -cookie random walk is zero. 

They also conjectured that when M{2p — 1) > 2, the speed should be non-zero. The aim 
of this paper is to prove that such is indeed the case. 

Theorem 1.1. Let X denote a (M,p)-cookie random walk, then 

lim — = v(M,p) > a(M,p) > 1 

n—*oo n 

where a(M,p) is given by (QJ). 

In particular, we see that a non-zero speed may be achieved for as few as 3 cookies per 
site. Comparing this result with the transience/recurrence criteria, we have a second order 
phase transition at the critical value a — 1. In fact, it shall be proved in a forthcoming 
paper that, for < a < 1, the rate of transience of X n is of order n~^r . 

One would certainly like an explicit calculation of the limiting velocity in term of the 
cookie environment (M,p) but this seems a challenging problem (one can still look at 
the end of Section 3 where we give an implicit formula for the speed). However, one can 
prove that the speed is continuous in p and has a positive right derivative at all its critical 
points: 

Theorem 1.2. • For each M, the speed v(M,p) is a continuous function ofp in Q^j. 

• For any environment (M,p c ) with a(M,p c ) = 1, there exists a constant C > 
(depending on (M,p c )) such that 

iim f M f = a 

S?£ a(M,p)-l 

a(p)>l 
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In particular, for M > 3, the (unique) critical value for an (M, [p]jvf)-cookie random 
walk is p c = + \ and the function v(p) is continuous, non-decreasing, zero for p < p c , 
and admits a finite strictly positive right derivative at p c . 

The remainder of this paper is organized as follow. In the next section, we construct a 
Markov process associated with the hitting time of the cookie random walk. The method 
is similar to that used by Kesten, Kozlov and Spitzer [5] for the determination of the rates 
of transience of a random walk in a one-dimensional random environment. It turns out 
that, in our setting, the resulting process is a branching process with random migration. 
The study of this process and of its stationary distribution is done in Section 3. This 
enables us to complete the proof of Theorem 11.11 Finally, the last section is dedicated to 
the proof of Theorem 11.21 



2 An associated branching process with migration 

In the remainder of this paper, X = (X n ) n > will denote a (M,p)-cookie random walk. 
Since the speed of a recurrent cookie random walk is zero, we will also assume that we 
are in the transient regime i.e. 

M 

a(M,p) = J2( 2 Pi ~ !) - 1 > 0- (2) 

i=l 

For the sake of brevity, we simply write P x for P(m,p),x and P instead of Po (the process 
starting from 0). Let T n stand for the hitting time of level n > by X: 

T n = M{k > , X k = to). (3) 

For < k < to, let U™ denote the number of jumps of the cookie random walk from site i 
to site i — 1 before reaching level to 

V? = tt{0 < k < T n , X k = i and X k+1 = i - 1}. 

Let also K n stand for the total time spent by X in the negative half-line up to time T n 

K n = fl{0 < k < T n , X k < 0}. 

A simple combinatorial argument readily yields 

n 

T n = K n -UZ + n + 2j2U£. 

Notice that, as to tends to infinity, the random variable K n increases almost surely toward 
Koo, the total time spent by the cookie random walk in the negative half line. Similarly, 
Uq increases toward Uq° the total number of jumps from to —1. Since X is transient, 
Koc + is almost-surely finite and therefore 

n 

T n ~ U + 2J2UI (4) 

fc=0 
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Let us now prove that for each n, the reverse process (£/", U^_ 1: . . . , U™, Uq) has the same 
law as the n first steps of some branching process Z with random migration. We first 
need to introduce some notations. Let (Sj)j>i denote a sequence of independent Bernoulli 
random variable under P with distribution: 



For j 6 N, define 



and 



P{B i = l} = l-P{B i = 0} = -[ » (5) 



fcj- = minO > 1, #{1 < i < jfc, B 4 = 1} = j + 1) 



Aj = (t{l < i < fcj, 5, = 0} = — j — 1. 
We have the following easy lemma: 

Lemma 2.1. • For any i,j > 0, we have P{Aj = i} > 0. 
• For all j > M , we have 

V= AM-1 + Zl + ... + tj-M+l (6) 



where (^i)*>o « 5 fl sequence of i.i.d. geometrical random variable with parameter \ 
independent of Am-i- 

Proof. The first part of the lemma is a direct consequence of the assumption that p is 
such that pk < 1 for all k. To prove the second part, we simply notice that few-i > M so 
that for j > M, the random variable Aj — Am-i has the same law as the random variable 

min(> > 1, < % < k, % = 1} = j + 1 - M) - j - 1 + M (7) 

where (Bj)j>o is a sequence of i.i.d. random variables independent of Au-\ and with 
common Bernoulli distribution P{B { = 0} = P{Bi = 1} = |. It is clear that (J7]) has the 
same law as £i + . . . + £j-m+i- D 

By possibly extending the probability space, we now construct a process Z = (Z n , n > 
0) and a family of probability (P 2 ) 2 >o such that, under P z , the process Z is a Markov 
chain starting from z, with transition probability: 

F Z {Z = z} = l, 

F z {Z n+1 = k\Z n =j} = P{Aj = k}. 

Since the family of probabilities (P z ) depends on the law of the cookie environment (M, p), 
we should rigourously write P(M,p),a instead of P z . However, when there is no possible 
confusion we will keep using the abbreviated notation. Furthermore, we will simply write 
P for P and E will stand for the expectation with respect to P. 

Let us now notice that, in view of the previous lemma, Z n under P 2 may be interpreted 
as the number of particles alive at time n of a branching process with random migration 
starting from z, that is a branching process which allows immigration and emigration (see 
Vatutin and Zubkov [9] for a survey on these processes). Indeed: 
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• If Z n — j > M — 1, then according to Lemma 12.11 Z n+ i has the same law as 
J2i=i I+1 ^ k + Am-i, i-e. M — 1 particles emigrate and the remaining particles 
reproduce according to a geometrical law with parameter ^ and there is also an 
immigration of A M _ X new particles. 

• If Z n = j G {0, . . . , M — 2} then Z n+1 has the same law as A, e. all the j particles 
emigrate and Aj new particles immigrate. 

We can now state the main result of this section: 

Proposition 2.2. For each n G N, (U™, U™_ 1: . . . , Uq ) under P aas £ne same law a,s 
(Z , Zi, . . . , Z n ) under P. 

Proof. The argument is similar to the one given by Kesten et al. in [5]. Recall that 
represents the numbers of jumps of the cookie random walk X from i to i — 1 before 
reaching n. Then, conditionally on ([/", f/"_ 1; . . . , the number of jumps U™ from i 

to z — 1 depends only on the number of jumps from i + 1 to i, that is, depends only of 
U™ +1 . This shows that ({/", 6 r ^_ 1 , . . . , C/q 1 ) is indeed a Markov process. 

By definition, Z = P-a.s. and U% = P-a.s. It remains to compute P{?7™ = 
I f^i+i = j}- Note that the number of jumps from i to % — 1 before reaching level rt is 
equal to the number of jumps from i to z — 1 before reaching i + 1 for the first time plus 
the sum of the number of jumps from i to i — 1 between two consecutive jumps from i + 1 
to i which occur before reaching level n. Thus, conditionally on {U™ +1 = j}, the random 
variable U™ has the same law as the number of failures (i.e. = 0) in the Bernoulli 
sequence (£>i, B 2 , B 3 , . . .) defined by ((SJ) before having exactly j + 1 successes. This is 
precisely the definition of Aj and therefore P{I7" = | U™ +1 = j} = Pj{Zi = k}. □ 

Since Uq is the number of jumps from to —1 of the cookie random walk X before 
reaching level n and since we assumed that the cookie random walk X is transient, Uq 
increases almost surely toward the total number U£° of jumps of X from to —1. In 
view of the previous proposition, this implies that under P, Z n converges in law toward a 
random variable which we denote by Z^. 

Let us also note that Z is a irreducible Markov chain (this is a consequence of part 1 
of Lemma [2TT|) . Since Z converges in law toward a limiting distribution, this shows that 
Z is in fact a positive recurrent Markov chain. In particular, Z n converges in law toward 
independently of its starting point {i.e. the law of Z^ is the same under any F x ) and 
the law of Z^ is also the unique invariant probability for Z . 

Corollary 2.3. Recall that v(M,p) denotes the limiting speed of the cookie random walk 
X. We have 

v(M, p) = ^ , (with the convention = ). 

In particular, the speed of an (M,p) -cookie random walk is non zero i.i.f. the limiting 
random variable Z^ of its associated process Z has a finite expectation. 

Proof. Since X is transient, we have the well known equivalence valid for v G [0, oo] : 

Xn t-, , . T n 1 , . 

> v P-a.s. <^=^ ► - P-a.s. (8) 
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On the one hand, this equivalence and (jlj) yield 



n 

77 ^ K n- 



1 1 „ 

- P-a.s. (9) 



n ^ fc «->oo 2v(M,p) 2 

On the other hand, making use of an ergodic theorem for the positive recurrent Markov 
chains Z with stationary limiting distribution Z^, we find that 

1 n 

-Y z k -> ^[Zoo] P-a.s. (10) 

j=l 

(this result is valid even if EfZ^] = oo). Proposition 12.21 implies that the limits in (jSJ) and 
(fTUl ) are the same. This completes the proof of the corollary. □ 

Remark 2.4. We assumed in the definition of an (M,p) cookie environment that 

Pi ^ 1 for alll<i< M. 

This hypothesis is intended only to ensure that Z starting from is not almost surely 
bounded (for instance, if pi — 1 then is a absorbing state for Z). More generally, one 
may check from the definition of the random variables Aj that Z starting from is almost 
surely unbounded i.i.f. 

B{1 < j < i , Pj = 1} < ^ for alll<i< M. (11) 

When this condition fails, Z starting from is almost surely bounded by M — 1, thus 
EJZqo] < oo and the speed of the associated cookie random walk is strictly positive. Oth- 
erwise, when ( fill) is fulfilled, Z ultimately hits any level x G N with probability 1 and the 
proof of Theorem li.il remains valid. 



3 Study of Z^. 

We proved in the previous section that the strict positivity of the speed of the cookie 
random walk X is equivalent to the existence of a finite first moment for the limiting 
distribution of its associated Markov chain Z. We shall now show that, for any cookie 
environment (M,p) (with a(M,p) > 0), we have 

EfZoo] =E W) [Z M ] < oo ^ a(M,p)>l. 

This will complete the proof of Theorem 11.11 We start by proving that Z^ cannot have 
moments of any order. 

Proposition 3.1. We have 

E [ZZ- 1 ] = +oo. 
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Proof. Let us introduce the first return time to for Z: 

a = inf(n > 1 , Z n — 0). 

Since Z is a positive recurrent Markov chain, we have 1 < E [o"] < oo and the invariant 
probability measure is given for any y G N by 



nZoo = y} = 

A monotone convergence argument yields 



E [E 



(7-1 -r, 

k=0 & Z k =y 



En 



cr-1 



_fc=0 



E [a]E[Z 



M-ll 
oo J 



(12) 



(where both side of this equality may be infinite). We can find n G N* such that 
F {Z no = M, n < a} > (in fact, since we assume that Pi < 1 for all i, we can choose 
n = 1). Therefore, making use of the Markov property of Z, we find that 



En 



(7-1 



fc=0 



(7-1 



fc=0 



> P {Z no = M, n < a}E A/ 

oo 

= F {Z no = M,n < a}J2®M [Zj^ 1 ] . 
In view of (fT2l) and (jT3j) , we just need to prove that 

oo 



(13) 



(14) 



k=0 



We now use a coupling argument. Let us define a new Markov chain Z such that, under 
F z , the process evolves in the following way 



if Z n = k G {0, 1, . . . , M - 1} then Z n+1 = 0, 



• \i Z n = k > M — 1 then has the same law as Y^=i & where (6)i>i is a 
sequence of i.i.d. geometrical random variables with parameter |. 

Thus, Z is a branching process with emigration: at each time n, there are min(Z n , M — 1) 
particles which emigrate the system and the remaining particles reproduce according to 
a geometrical law of parameter |. 

Recall that Z is a branching process with migration, where at most M — 1 particles 
emigrate at each unit of time, and has the same offspring reproduction law as Z. There- 
fore, for any z > 0, under P 2 , the process Z is stochastically dominated by Z. Since is 
an absorbing state for Z, this implies that, for all n > and all z > 0, 



E.fZf- 1 ] < E,[Z ; 



nAcr 



(15) 
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Our process Z belongs to the class of processes studied by Kaverin [4]. Moreover, all the 
hypotheses of Theorem 1 of [4] are clearly fulfilled (in the notation of [4], we have here 
A = 6 = M — 1 and B = 1). Therefore, for any z > M, there exists a constant c > 
(depending on z) such that 

E Z [Z^] ~ °-. (16) 

The combination of and (1(3) yield JH]). □ 

Remark 3.2. In view of the last proposition and CoroUary \2.3l we recover the fact that 
for M = 2, the speed of the cookie random walk is always zero. 

In order to study more precisely the distribution of Z^, we will need the following 
lemma 

Lemma 3.3. We have 

M 



E[^_i] =2^(1 - Pi ) 



i=l 



Proof. Recall that (£>j)j>i denotes a sequence of independent Bernoulli random variables 
with distribution given by (JSJ). Recall also that 

k M -i = min(A; > 1, |J{1 < i < k, B, t = 1} = M), 
A M _ X = k M -i-M. 

In particular, for any j G KT* 

P{A M _ l =j] = P{k M . 1 = M + j} 

= P{tt{l < i < M + j - 1, Bi = 1} = M - l}P{B M+j = 1}. 

Hence, 
P{A M -i=j} 

-^p{tt{l<*<M, B % = 1} = M-/}p{(l{M+l < z < M+j-^B, = 1} = Z-l} 



Z=l 
MAj 



£ P{il{l < i < M, Bi = 1} = M - l)C l r\ U • 



Let L = %{\ < % < M, Bi = 0}, therefore 

MAj 



nin J /lV 
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Making use of the relation jC l j_\ = ICj, we get 



j=i 1=1 ^ ' 

= E ip { £ =<>£(}) c; 



Z=0 j=J 
M 

= 2^T/P{L = /} 
= 2E[L]. 

We now compute E[L] by induction on the number of cookies. 

i 

P{L = l}= II^-^) II Pi forO</<M. 

l<ii<i 2 <...<ii<M j=l 

Decomposing the last sum according to whether ii — 1 or %\ ^ 1, we obtain 
E[L] 

M i M-l i 

=E ; E a-pi)n(i-fti)IIft-+E i E U^-ptM 

Z=l 2<j 2 <...<i;<A/ i=2 J'g{l,t2,->*j} '=0 2<ii <...<tj< JM"i=l 

= E( / -( 1 -^)) E U^-p^Upi 

1=0 2<i 1 <...<i l <M j=l JfKMl.-,*!} 

M-l 

= E( / -( 1 -^)) p { z = / } 

£=0 

= E[L] + 1- Pl , 

where L = jj{2 < z < M, Bi = 0}. Finally, we conclude by induction that 

M 



E[L]=X)(l-ft). 



□ 



We now study the law of the limiting distribution of the Markov chain Z. This is 
done via the study of its probability generating function (p.g.f.) 

G(s) = E [s Zo °] for se [0,1]. 

Lemma 3.4. The p.g.f. G of Z^ is the unique p.g.f. solution of the following equation 

1 - G ( — *— J = a(s)(l -G(s)) + 6(s) /or aH s e [0, 1], (17) 



2- s 
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with 
and 

k.) = , ! + y G « ( o) C ^ L_ 

1 J (2 - s)^-!E [s^-i] ^ I (2 - s) M ~ l E [s a m-i] (2 - s) 

Proof. The law of Z^ is a stationary distribution for the Markov chain Z, therefore 



G{s) = E[E Zoo [s Zl ]] = = fc}E fc [s* 1 ] 

fc=0 

M-2 oo 

= = fc}E fc [s* 1 ] + J2 nZoo = k}E k [s z ^}. 



k=0 k=M-l 



By definition of Z, for < < M — 2, Zi under Pfc has the same law as A\. under P. For 
k > M — 1, Z x under P& has the same law as A M _i + £i + . . . + ^_m+i where (£t)i>i is a 
sequence of i.i.d. random variables independent of Am-i and with geometric distribution 
with parameter |. Thus, 



M-2 



G(s) = p i z °° = fc ) E i sAk ] + F ^ Z °° = k ^ E [s Au - 1+ * 1+ ~ + t k+1 - M ] 

k=0 k=M-l 

= ^P{Z QO = fc}E [ B ^]+ -LJ £ P{Z 00 = fc}E^] fc 



E[^] 

M-2 pp r Am-i1 



fe=0 L J fc=M-l 

M-2 



fc=0 



Since E [a*] = and PjZ^ = A;} = G fc (0), we get 

M-2 / i \ 

G( s ) = G fe (0) ( E M - E i 3 ^"- 1 } ( 2 - s) M " 1 - fe )+E [s A ^] (2-s) M - 1 G ( — ^- , 
k=o ^ 2 s / 

from which we deduce that G solves (TP7I) . Furthermore, the uniqueness of the solution of 
this equation amongst the class of probability generating function is a direct consequence 
of the uniqueness of the stationary law for the irreducible Markov chain Z. □ 

Given two functions / and g, we use the classical notation f(x) = 0(g(x)) in the 
neighbourhood of zero if \ f(x)\ < C\g(x)\ for some constant C and all \x\ small enough. 



Lemma 3.5. The functions a and b of Lemma \3.J\ are analytic on (0,2). In particular, 
they admit a Taylor expansion of any order near point 1 and, as x goes to 0: 

a(l — x) = 1 — ax + 0(x 2 ), 
6(1 -x) = 0(x). 
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Proof. Recall the definitions of the random variables given in Section 2. Since a 
geometric random variable with parameter \ admits exponential moments of order strictly 
smaller than 2, it follows that the p.g.f. s h- > E,[s Ak ] are strictly positive and analytic on 
(0,2). From the explicit form of the functions a and b given in the previous lemma, we 
conclude that these two functions are indeed analytic on (0,2). A Taylor expansion of a 
near 1 gives 

a(l — x) — 1 — (M — 1 — E[Am-i]) x + 0(x 2 ) = 1 - ax + 0(x 2 ), (18) 

where we used Lemma f3T3l for the last equality. Since G is a p.g.f. we have G(l) = 1 
which, in view of (TITl) . yields 6(1) = and therefore 6(1 — x) = 0(x). □ 



The following proposition relies on a careful study of equation ( 1171 ) and is the key to 
the proof of Theorem 11.11 



Proposition 3.6. Recall that 

M 



a = 

i=l 



- 1) - 1 > o. 



The p.g.f. G of is such that, as x goes to 0: 

• ifO < a < 1, then 1 — G(l — x) ~ c\x a , for some constant c\ > 0. 
In particular E[Zoo] = +oo. 

• if a = 1, then 1 — G(l — x) ~ C2x\ \nx\, for some constant C2 > 0. 
In particular 'E[Z 00 \ = +00. 

• if a > 1, then 1 — G(l — x) = c 3 x + 0(x 2Aa ) for some constant c 3 > 0. 
In particular E[Zoo] < +00. 

Proof. Since G is a p.g.f, it is completely monotonic and we just need to prove the propo- 
sition along the sequence x = - with n e N*. Making use of Lemma I3T41 with s — 1 — -, 
we get, for all n > 1 



n + 1 J \ n I \ \ ni) \ n 

Let us define the sequence (w n )n>i by 

Ml = l-G(0) = l-P(Z oo = 0)>0, 

_ l-G(l-Vn) f > 2 (19) 

n ~ nr^i 1 «(i-i/o - 

Hence, (u n ) is a sequence of positive numbers and satisfies the equation 

b(l - l/n) 
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hence 

6(1 - m 



u n = ui + y — — 



L/i) 

This equality may be rewritten 

n— 1 / -, \ / n— 1 



Using Lemma 13751 we easily obtain 



n"( i -7)=^( i+o S))- w,thc4>0 - (21) 

Lemma 13.51 also states that, when b is not identically then there exists a unique k e 
{1,2,...} such that 

6(1 -x) = D k x k + 0(x k+1 ), withD fc ^0. 

If 6 is identically 0, we use the convention k = +oo. In particular, when k is finite, using 
IpTil we deduce that 

- D k cl l n a ~ k + 0(n a - k ~ l ). (22) 



nr=i«(i-iA) 



Let us now suppose that k — 1. Combining (1201) . (12TI ) and ( 1221 ) we find that 1 — (7(1 — -) 
converges towards — ^ as n tends to infinity but this cannot happen because G is 
continuous at 1~ with G(l) = 1. Thus, we have shown that in fact 

jfe > 2. 

We now consider the three cases a > 1, a — 1, a < 1 separately. 



a > 1 



We have three sub-cases: either a>k — 1, or a<k — 1, or a = k — 1 with fc > 3. 
• a > k — 1 : Making use of ([22]) . we have 



V 6(1 - 1/J) = Dk f + 0(1 V n«" fc ) 



By pUll and (f2TT). we deduce that 



1-GI1--W ,^ ; , , +0 / 



nj (a-k + l)^- 1 \n kAa 
If k was strictly larger that 2, we would have 

lim n{\ - G(l - I /n)) = 

n— >oo 

13 



and therefore G'(l) = E[Zoo] = which cannot be true because Z is a positive 
random variable which is not equal to zero almost surely. Thus k must be equal to 
2 and 

l\ = D - + (J 

n I (a — l)n \ n 2 



l-G[l--)= 7 ^^; + 0[-—). (23) 



a < k — 1 : We prove that this case never happens. Indeed, in view of (l22|) we find 
that, for any e G (0, k — 1 — a) 

6(1 - l/n) 1 \ 

-O(-j-) (24) 



n: =1 a(i-iA) v +e 

(this result also trivially holds when k = oo), thus 

£ b{1 - lt3) <oo. 

Combining this with (|20|) and (T2T1) we see that 

i-Gfi-ruofj.' 

Since a > 1, just as in the previous case, this implies that E[Zoo] = which is 
absurd. 



a = k — 1 and k > 3 : Again, we prove that this case is empty. Using (1221 ). we now 
get 

6(1 ~ l/n) DkCl 1 

nr=i "a - ia) ~ n ■ 

And, by (|20|) and (l2Tl) . we conclude that 

i-eii-iW 11 " 



Since fc > 3, we obtain EfZoo] = which is unacceptable. 

Thus, we have completed the proof of the proposition when a > 1 and we proved by the 
way that k must be equal to 2. 



a 



We first prove, just as in the previous cases, that k — 2. Let us suppose that k > 3. 
In view of Lemma [3.51 for any / > 3, we can write the Taylor expansion of b of order I 
near 1 in the form 

6(1 -x)= D 3 x 3 + ... + Dix 1 + 0(x l+1 ) (25) 
where Di G M for i G {3, 4, . . . , /}. Similarly, 

a(l-x) = l-x + a 2 x 2 + . . . + aix 1 + 0(x l+1 ), 
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from which we deduce that, as n goes to infinity 



f[a(l--) =- + - 2 +--- + ^ + o(4n) witha;>0. (26) 

i=l x ' x ' 



From (|25|) and (l26j) we also deduce that 



6(1 -1/n) _4 



Q™ =1 a(l — 1/ij ri" 5 n' 1 \n 

Thus, 

Therefore, in view of ([20]), (EH) and ([27]), we get 

Ai , A2 , , A;_i / 1 



n n 2 n z_1 V u l 



Comparing with the Taylor expansion of the p.g.f. G, we conclude that E^^ 1 ) < 00 for 
all / which contradicts Proposition 13. 1[ Thus, k = 2 and ([22]) yields 



nr=i«(i-iA) 

And, by ([20]) and ([ZD), we conclude that 



1-C|1-IV^, 



/ n 



and therefore 

E^] = +00. (28) 



a < 1 

Since k > 2, the relation ([22]) yields 

re., «(i - 1/0 

(of course, this is trivially true when k = 00). Thus, the sequence (it n ) defined by ([19]) 
converges to a constant c 5 > 0. Suppose first that c 5 = 0. In this case, k cannot be 
infinite (because when k = 00, the sequence (u n ) is constant and then c 5 = u x > 0). From 
([22] ) we deduce that 

^ 6(1 ~ 

w — — — y rs - / 
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therefore, with the help of ([21]) we get that 



(k — a — l)n 



k-l ' 



Since k > 2, this implies that n(l — G(l — 1/n)) converges to a finite constant and so 
E[Zoo] < oo. We already notice that this implies a strict positive speed for the cookie 
random walk in the associated cookie environment (M,p). But (by possibly extending 
the value of M) we can always construct a cookie environment (M, q) such that p < q 
and a(q) = 1. In view of ( [28] ), the associated cookie random walk has a zero speed and 
this contradicts a monotonicity result of Zerner (c.f Theorem 17 of pH]). Therefore c 5 
cannot be and by (fl9l) and (T2T1) . we get that 

1 \ TT / 1 \ C5C4 



G H)—n 



□ 

As we already noticed, Theorem II .11 is now a direct consequence of the last proposition 
and Corollary 12.31 We also proved that, when the speed is strictly positive, its value is 
given by the formula 

a - I 

where 2£>o = b"(l) > 0. 



a - 1 + 2D? 



Remark 3.7. In the transient case and when the limiting speed is zero, Proposition \3.6i 
gives with the help of a classical Abelian / Tauberian Theorem the asymptotic of the distri- 
bution tail of Zoo i.e. the distribution tail of the total number of jumps from to —1: 

^{Zoo>n} ~ { |L <lj (29) 

n— >oo I IJ Oi — 1. 



The functional equation given in Lemma [X^] for the p.g.f of also gives a similar 



equation for the total number of returns R to the origin for the cookie random walk. 
Indeed, recall that Uq (resp. U™) stands for the respective total number of jumps from 
to — 1 (resp. from 1 to 0) before reaching level n. Thus, the total number of returns to 
the origin before reaching level n is Uq + [/" which, under P has the same distribution as 
Z n + Z n _i under P. Therefore, we can express the p.g.f. H of the random variable R in 
term of G: 



H(s) = E[s z °°E Zao [s z ™]] 



as 



In particular, Proposition ^. bA also holds for H and the tail distribution of the total number 
of returns to the origin when a < 1 has the same form as in ( TgPj) . 
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Remark 3.8. In the particular case M = 2 (there are at most 2 cookies per site), the 
only unknown in the definition of the function b is G(0). Since we know that b'(l) = 
( c.f. the beginning of the proof of Proposition Iff.fijj we can therefore explicitly calculate 
G(0), that is the probability that the cookie random walk never jumps from to 1 which is 
also the probability that the cookie random walk never hits — 1. According to the previous 
remark, we can also calculate the probability that the cookie random walk never returns to 
0. Hence, we recover Theorem 18 of flb^ in the case of a deterministic cookie environment. 



4 Continuity of the speed and differentiability at the 
critical point 

The aim of this section is to prove Theorem 11.21 Recall that 



v(M,p) 



tta(M,p)<l, 
Q _r + " b "(i) if«(M,p)>l, 



where b"{\) stands for the second derivative at point 1 of the function b defined in Lemma 

Hc) .! i | y-V h] ( E [«*] _!_ 

1 J (2 - s^E [s^m-i] + 2^ rtZ/ °° K * y (2 - s )m-i E (2 - 

Furthermore, we also proved in Proposition 13.61 that, when a(M, p) = 1, then b"{l) 
is strictly positive. Hence, in order to prove Theorem 11.21 we just need to show that 
b"{\) = fr(Vp)(l) is a continuous function of p in Q^. It is also clear from the definition 
of the random variables Ak that the functions 

p — > (E( A /p) [V 4 *])^ (1) (i.e. the i th derivative at point 1) 

are continuous inp in for all k > and alH > (it is a rational function mpi, . . . ,Pm)- 
Therefore, it simply remains to prove that, for any k > 0, the function 

P -> P(M,p) {Zoo = 

is continuous in f2 A/ . The following lemma is based on the monotonicity of the hitting 
times of a cookie random walk with respect to the environment. 

Lemma 4.1. Let (M,p) be a cookie environment such that a(M,p) > 0. Then there exist 
e > and / :Ni-> R+ with lim n ^ +00 /(n) = such that 

Vg e B(p,e),Vj e N, Vn e N, |P (M , ? -) = j} - P(m, 5) {Z n = j} I < /W, 
£(p,e) = = • • -,9m), g ^ ft < !» a ( M A) >0 and^ \Pi ~ ft I ^ e }- 
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Proof. Let us fix (M,p) with a(M,p) > 0. For e > 0, define the vector p £ = {p\ , . . . , p^) 
by Pt = rnax(i,p,j — e). We can choose e > such that a(M, p e ) > 0. Then, for all 
q G B(p,e), we have 

P e < q (30) 

(where < denotes the canonical partial order on R M ). Let now pick q G B(p,e), j G N 
and n G N. Recall that Uq° denotes the total number of jump of the cookie random walk 
from to —1 and 

P(M,g){^oo = j} = P(M,q){U™ = j} = P( A f i5 ){X jumps j times from to -1}, 

and 

F (Am {Z n =j} = P [Am {UZ=j} 

= P(M,q){X jumps j times from to -1 before reaching n}. 

Hence 

|P(M,«?){^o = j} ~ W {M4) {Z n = j}\ = \P(A m {U™ = j} - P(M,,){K = J}\ 

= P(M, 5 ){A}, (31) 

where A is the event "X visits — 1 at least once after reaching level n" . Recall the nota- 
tion uj = uj(i, x)i>i tX& z for a general cookie environment given in the introduction. Let now 
&x,n denote the (random) cookie-environment obtained when the cookie random walk X 
hits level n for the first time and shifted by n, i.e. for all x G Z and i > 1, if the initial 
cookie environment is u, then 

vx,n(h x ) — x + n ) where j = i + jj{0 < k < T n , X k = x + n}. 

With this notation we have 

P(M,q) {A} = E(m,5) [P^,„{^ visits -(n + 1) at least once}] . 

Besides, X has not eaten any cookie at the sites x > n before time T n . Thus, the 
environment u>x,n satisfies P(m,?) -almost surely 

wjf,n(i, x) = q%i for all x > and i > 1 (with the convention qi = \ for i > M). 

Hence, in view of (l30l) . the random cookie environment uix,n is P(M,q) -almost surely 
larger (for the canonical partial order) than the deterministic environment LOpe defined by 

J Upe(i,x) = |, for all x < and i > 1, 

[ ^(z, x) = pf , for all a; > and % > 1 (with the convention = | for i > M). 
Thus, Lemma 15 of [10] yields 

P WXn {X visits — (n + 1) at least once} 

< P W _ £ {X visits — (n + 1) at least once} P(m,q) — as. 
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In view of (l3~Pj) we deduce that 

|P(M,g){^oo = J} - IW){Zn = j}| < f{n), 

where f(n) = P w £ {X visits — (n + 1) at least once} does not depend of q. It remains to 
prove that f(n) tends to as n goes to infinity. Let us first notice that 

P^-e{Vn > 0, X n > 0} = P(M, r) {Vn > 0, X n > 0}, 

since these probabilities depend only on the environments on the half line [0, +oo). Recall 
also that the cookie random walk in the environment (M,p 6 ) is transient (we have chosen 
e such that a(M, p £ ) > 0), thus 

P(M^){Vn > 0, X n > 0} = P ( M, P -){f/ 00 = 0} = P(a/,^){^oo = 0} > 0. 

Hence 

P w ^{Vn > 0, X n > 0} > 0, 

which implies 

PuipAXn = infinitely often} < 1, 
and a — 1 law (c.f. Proposition 5 of pU]) yields 

Pu) P s {X n = infinitely often} = P w _ e {X n < infinitely often} = 0. 

Therefore, lim n ^oo f{n) =0. □ 

Recall that the transition probabilities of the Markov chain Z are given by the law of 
the random variables A^: 

P(A/,p) {Z n+1 = j | Z n = i} = P(m,p) {Ai = j} . 

It is therefore clear that for each fixed n and each k, the function p — > P(m,p) {Z n = k) is 
continuous in p in H^. In view of the previous lemma, we conclude that for each k the 
function p — > P(a/,p) {-^oo = k} is also continuous in p in Vt^ and this completes the proof 
of Theorem ll.2[ 

Acknowledgments. The authors would like to thank Yueyun Hu for all his precious 
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